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(54) Method and system for associating actions with semantic labels In electronic documents 



(57) A method and system are provided for associ- 
ating actions with semantic labels in an electronic doc- 
ument. The document Is created or edited in an appli- 
cation program module and sections of the electronic 
document are annotated with semantb labels. The ap- 
plication program module passes the semantk: labels to 
an action DLL. The action DLL is responsible for oom- 
munlca|[ing with the application program module, trans- 



mitting the labels to actran plug-ins, and receiving, from 
the action plug-ins, the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the semantic labels and displays them to a user. 
The document may be created in extensible Markup 
Language (XML) and may be annotated using XML 
tags. The semantic labels may be associated with 
strings of text or graphtoal objects 
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Description 
Field of Invention 

[0001] The present invention relates to a method and 
system for associating actions wiOi semantic labels In 
an electronic document. 

Background of ttie Invention 

[0002] Electronic documents such as word process- 
ing documents, e«mall messages, and spreadsheet 
documents typically include semantic information which 
may be recognized as belonging to a particular semantic 
caiegoiy and associated with one or more actions rele- 
vant to tfie category. Recognition and use of this seman- 
tb infomiatlon provides increased interoperability be- 
tween desktop software applbations and other desktop 
applications and^or web-based applications. Exemplary 
functions, features, and operations may include auto- 
matically addressing an e^all message, performing a 
look up in a cooperating database, providing a hyperlink 
to one or more Internet web pages and providing en- 
hanced content. 

[0003] One current scheme for recognUring strings in- 
volves utilizing an application program module to pass 
a string of text (e.g.. a paragraph) entered into an elec- 
tronb document to a recognizer. The recognizer parses 
the string for know) keywords which are then complied 
Into semantic categories. Each recognized string is then 
labeled with the title of the semantfc category to which 
it belongs. For example, when a user types the string 
"Bob Smith" which is known to the recognizer as a key- 
word, the recognizer compiles the string Into the seman- 
tic category labeled "name." After the string has been 
complied, the appiicatk>n program module may display 
to the user a selection of actions associated with the 
semantic category label In the electronic document. For 
example, the semantb category label "name* may be 
associated with the action "Add name to contacts fold- 
er- 

[0004] Independent software developers are often not 
in the best posltbn to detemilne all of the semantic in- 
formatksn that individual users need to be recognized in 
electronic documents. Cun'ent schemes, however, are 
limited in that they require strings of text In the electronic 
document to contain keywords which are known to a 
recognizer to Incorporate semantic category labels and 
make actions available to the user. That is, If a string of 
text (e.g.. a person's name) does not match a list ol key- 
words known to the recognizer, the string will not be la- 
beled as a semantb category and no actions wiD be as- 
sociated with the string. Moreover, current schemes are 
further limited in thai they are unable to recognize and 
associate actions with non-&trlng data (e.g., Images, 
photos, drawings, and other Insertable objects) whbh 
may be in a document. 

[0005] Thus, there is a need for a method and system 



for allowing actions to be associated with arbitrary 
strings or other types of content, such as images, pho- 
tos, drawings and other insertable objects in en elec- 
tronic document without the need for recognition. 

5 

Summary of the Invention 

[0006] illustrath^e embodiments of the present inven- 
tion satisfy the above described needs by providing a 
^0 method and system for associating actions with seman- 
tically labeled strings of text or other content without the 
need for recognition. 

[0007] In one embodiment, the present Inventbn pro- 
vides a method for associating actions with semantic la- 
bels in an electronb document. When the document Is 
created or edited In an applbation program module, sec- 
tions of the electronb document are annotated with se- 
mantic labels. In the present embodiment, the document 
may be created using eXtensble Markup Language 

^ (XML) and the semantic labels may be XML tags. The 
application program module then passes the labels to 
an action DLL. The action DLL Is responsible for com- 
munbating with the application program module, trans- 
mitting the labels to actbn plug-ins. and receiving, from 

^5 the action plug-ins, the actions to be associated with the 
labels. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the semantb labels and displays them to a user. 
The semantb labels may be associated with strings of 

so text or graphical objects. 

[0008J These and otherfeatures. advantages, and as- 
pects of the present invention may be more deariy un- 
derstood and appreciated fonn a review of the following 
detailed description of the disclosed embodiments and 

35 by reference to the appended drawings and claims. 

Brief Description ol the Drawings 
(0009] 

40 

Rg. 1 is a blockdiagramofacomputerthat provides 
the exemplary operating environment for the 
present Invention. 

Fig, 2 is a block diagram illustrating an exemplary 
<5 architecture for use in conjunction with an embodi- 
ment of the present invention. 
Fig. 3 is a flow chart illustrating a method for incor- 
porating semantic labels and actions during crea- 
tion of an electronb document in accordance with 
50 an Illustrative embodiment of the present Invention. 
Fig. 4 is a flow chart illustrating a method (or asso- 
ciating actions with semantic labels In accordance 
with an illustrative embodiment of the present in- 
vention. 

55 

Detailed Description of lilustrative Embodiments 
pOlO] The present inventbn is directed toward a 
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method and system for associating actions with seman* 
tic labels In an electronic document 
[0011] In one embodiment the Invention is incorpo- 
rated Into a suite of application programs referred to as 
"OFFICE," and more paitlcularly Is Incorporated into a 
word processing application program entitled "WORD" 
and a spreadsheet appllcatbn program entitled "EX- 
CEL," both n^arketed by Microsoft Corporation of Red- 
mond, Washington. Briefly described, the application 
programs allow a user to create and edit electronic doc- 
uments by entering charwters, symbols, graphica] ob- 
jects, and commands. 

[0012] In one embodiment, the present invention in- 
cludes associating actions with seniantic lat>els in an 
electronic document. Wtien the document Is created in 
an application program module, sections of the electron- 
ic document are annotated with semantic labels. The 
application program nrwdule then passes the labels to 
an action DLL The action DLL is responstole for com- 
municating with the application program module, trans- 
mitting the labels to action plug-ins, and receiving, from 
the action plug-Ins, the actions to be associated with the 
Ial3els. The application program module communicates 
with the action DLL to retrieve the actions associated 
with the semantic labels and displays them to a user 
[001 3] Having briefly described en iRustiatlve embod- 
iment of the present invention, an illustrative operating 
environment for the present invention is described be- 
low. 

Exemplary Operating Environinent 

[0014] Referring now to the drawings, in which liice nu- 
n^rals represent liice elements throughout the several 
figures^ aspects of the present invention and the exem- 
plary operming environment will be described. 
[001 5] Fig. 1 and the following discussion are intend- 
ed to provide a brief, general description of a suitable 
computing environment In which the invention may be 
implemented. While the Invention will be described in 
the general context of an application program that runs 
on an operating system in conjunction with a personal 
computer, those skllted in the art will recognize that the 
invention also may be implemented In combination with 
otherprogram modules. Generally, program modules in- 
clude routines, programs, conrrponents, data structures, 
etc. that perform particular tasks or implement particular 
abstract data types. Moreover, those skilled in the art 
will appreciate that the Invention may be practiced with 
other computer system configurations, including hand- 
held devices, multiprocessor systems, microprocessor- 
based or programmable consumer electronk:s. cell 
phones, minkxmputers, mainframe computers, and the 
like. The inventk)n may also be practiced In distributed 
computing environments where tasks are perfonned by 
remote processing devices that are (iniced through a 
communications networit. In a distributed computing en- 
vironment, program modules may be located in botfi lo- 



cal and remote memory storage devices. 
[001 6] With reference to Rg. 1 . an exemplary system 
for implementing the Invention includes a conventional 
persona] computer 20, Including a processing unit 21 , a 
5 system memory 22, and a system bus 23 that couples 
the system memory to the processing unit 21 . The sys- 
tem memory 22 Includes read only memory (ROM) 24 
and random access memory (RAM) 25. A basic input/ 
output system 26 (BIOS), containing the basic routines 

10 that help to transfer information between elements with- 
in the personal computer 20, such as during start-up. is 
stored in ROM 24. The personal computer 20 further In- 
cludes a hard disk drive 27, a nrkagnetic disk drive 28, e. 
g., to read from or write to a removable disk 29, and an 

15 optical disk drive 30, e.g., for reading a CD-ROM disk 
31 or to read from or write to other optk»l media. The 
hard disk drive 27. magnetic disk drive 28. and optical 
disk drive 30 are connected to the system bus 23 by a 
hard disk drive Interface 32, a magnetk: disk drive viter- 

20 face 33, and an optical drive Interface 34, respectively. 
The drives and their associated computer-readable me- 
dia provide nonvolatile storage for Oie personal compu- 
ter 20. Although the description of computer-readable 
media above refers to a hard disk, a removable mag- 
netic disk and a CD*BOM disk, it should be appreciated 
by those skilled in the art that other types of media whk:h 
are readable by a computer, such as nnagnetic cas- 
settes, flash memory cards, digital video disks, Bemoullt 
cartridges, and the like, may also be used In the exem- 

30 plaiy operating environment 

[001 7] A number of program modules may be stored 
in the drives and RAM 25, including an operating system 
35, one or more applk^atlon programs 36, a word proc- 
essor program module 37 (or other type of program 

35 module), program data 38, and otfier program modules 
(not shown). 

[0018] A user may enter commands and infonnation 
into the personal computer 20 through a keyboard 40 
and pointing device, such as a mouse 42. Other input 

^0 devices (not shown) noay Include a microphone, Joy- 
stick, game pad, satellite dish, scanner, or the like. 
These and other input devices are often connected to 
the processing unit 21 through a serial port Interface 46 
(hat is coupled to Uie system bus, but may be connected 

^5 by other interfaces, such as a game port or a universal 
serial bus (USB). A monitor 47 or other type of display 
device Is also connected to the system bus 23 via an 
Interlace, such as a vkteo adapter 48. in addition to the 
monitor, personal computers typically Include other pe- 

50 ripheral output devices (not shown), such as speakers 
or printers. 

[0019] The personal computer 20 may operate in a 
networked environment using logical connections to 
one or more remote computers, such as a remote com- 
55 puter 49. The remote computer 49 may be a server, a 
router, a peer device or other common network node, 
and typically includes many or all of the elements de- 
scribed relative to the personal computer 20, although 
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only a memory storage device 50 has been illustrated 
in Figure 1. The logical connections depicted In Figure 
1 include a local area network (LAN) 51 and a wicte area 
network (WAN) 52. Such networking environments are 
commonplace In offices, enterprise-wide computer net- 
works, Intranets and the Internet 
[0020] When used in a LAN networldng environment* 
the peiBonal computer 20 is connected to the LAN 51 
through a network interface 53. When used in a WAN 
networldng environment, the personal computer 20 typ> 
icafly Includes a modem 54 or other means for estab- 
lishing communications over the WAN 52, such as the 
Internet. The modem 54, which nnay be internal or ex- 
Xornai, is connected to the system bus 23 via the serial 
port Interface 46. In a networked environment, program 
modules depicted relative to the personal computer 20, 
or portions the reof , may be stored in the remote memory 
storage device. It wfll be appreciated that the network 
connections shown are exemplary and other means of 
establishing a communications link between the com- 
puters may be used. 

[0021] Fig. 2 is a bk)clc diagram DIustrating an exem- 
plary architecture 200 for use In conjunction with an em- 
bodiment of the present Invention. The architecture In- 
cludes an applbation program module 205, such as 
word processor program module 37 (Fig. 1). The appli- 
cation program module 205 is able to communicate with 
an action dynamk^-Hnk library 215 (hereinafter actton 
DLL) as a user Is creating, editing, viewing, etc. an elec- 
tronb document. An action is a user-initiated function 
applied to a typed string or other content such as Imag- 
es, photographs, or drawings. The action DLL 21 6 con- 
trols a number of action plug-Ins 225. The action DLL 
also controls a type-action database 230. 
[0022] In an illustrative embodiment, the action plug- 
ins are Automation Servers. Automation Senders are 
well-known sofhvare components which ere assembled 
into programs or add functionality to existing programs 
running on the Mk:rosoft WlNCX^WSiD operating sys- 
tem. Automation Sen/ers may be written In a variety of 
computing languages and nnay be un-plugged from a 
program at run time without having to recompile the pro- 
gram. 

[0023] The action DLL 21 5 manages the action plug- 
ins 225 that are mn to execute the actions. The action 
plug-ins 225 may be packaged with the applk;ation pro- 
gram module 205 or written by third parties to perfomn 
particular actions that are of interest to the third party. 
The actbn plug-ins provide possible actions to be pre- 
sented to the user based upon the type label associated 
with the string or other content. The action DLL 215 de- 
termines what type \abe\ the semantk: category Includes 
and cross-references the type label in the type-action 
database 230 with a list of actions to detemnlne what 
actions to present to the user It should be understood 
that, in an illustrative embodiment, the type-action da- 
tabase is not used. Instead, the list of actions is dynam- 
ically generated for each type by looking in the registry 



to determine which actions are Installed and then que- 
rying the action DLLs to determine which types they ap- 
ply to. 

[0024] After the user chooses an action, the action 
5 DLL 215 manages the appropriate action plug-Ins 225 
and passes the necessary Informatbn between tfie ac- 
tion plug-Ins and the application pmgram module 205 
so that the action plug-In may execute the desired ac- 
tion. Typk;ally, the aii^licatlon program module sends 
10 the action DLL an automation request to invoke the ac- 
tion the user has sdlected. 

[0025] A download URL may be provided with the 
type labels In case the user's machine has not stored 
action plug-Ins for these type labels. If the user does not 

IS have the action plug-in DLL 225 conresponding to a la- 
bel, then the download URL may be used to navigate 
the user's web browser to an appropriate website to 
download this action plug-in. In other implenDcntations 
of the Invention, multiple download URLs may be pro- 

20 vided for a single type label. 

|P026] Having described an exemplary architecture, 
an exemplary method 300 for semanticaily labeling 
strings during document creation will be described be- 
low in reference to Figs. 2 and 3. 

25 

Method for Incorporating Semantic Labels and 
Acttons during Document Creation 

[0027] Fig. 3 is a flow chart Illustrating a method 300 
so for Incorporating semantic labels and actions during cre- 
ation of an electronic document. Those skilled in the art 
will appreciate that this is a con>puter-implemenled 
process that is carried out by the computer In response 
to input from the user and instructions provkJed by a pro- 
3s gram module, fn this embodiment, the user may be a 
software developer. 

[0028] Refen'Ing to Fig. 3, the method 300 begins at 
start step 305 and proceeds to step 310 when the de- 
veloper creates the electronic document in applteation 

40 program module 205. In one embodiment of the present 
Invention, the document may be in a template format 
allowing a user to input strings of text, or other content, 
such as an Image, photo or drawing, relevant to the doc- 
ument. For example^ if the document Is a will template, 

^5 \he document may have sections for the user to Input 
information such as name, place of residence, executor 
of the estate, and beneficiaries. Or if the document is a 
news artk;le, the document may have sections for the 
user to insert a related photo. Or if the document is a 

so business publication, it may have sections for a logo 
graphical element. In an illustrative embodiment, the 
electronic document is a word processing document or 
a spreadsheet document. However, the method Is not 
limited to efther of these specif types of electronic doc- 

55 uments. 

[0029] At step 31 0, sections of the document are an- 
notated with semantte labels which are to be associated 
with actions built by the developer. For example, If the 
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document being created is a wiO template having a sec- 
tion that requests a person's residence and that section 
Is annotated with the semantic label 'Place of Resi- 
dence/ then ections for the "Place of Residence" label 
will be available for that section regardless of the text 
$tring Input by the user. In one embodiment of the 
present invention, the document Is created in XI^L and 
annotated using XML tags to label the document The 
XML maybe written using any editing tool or XML editing 
tool. For example, the residence section of the will tem- 
plate would be annotated with the <place of residence> 
XML element The method 300 then proceeds to step 
315. 

[0030] At step 315, the developer builds action plug- 
ins 225 to provide and execute the actions for each se- 
mantic label (e.g., XML element) In the annotated doc- 
ument. After a string Is labeled with a particular semantic 
label, the user will be able to execute action ptug-ins 
pertaining to that label. For Bxample, for the "Place of 
Residence* label in a will document, the developer may 
build actions whbh provide the user with the option to 
review the taws relating to wills which are particular to 
the user^ state of residence. The method 300 then ends 
at step 399. 

Method for Associating Actions ¥flth Semantic 
Labels 

[0031] Fig. 4 is a flow chart illustrating a method 400 
for associating the created semantic labels with the ac- 
tion plug-ins 225 discussed in Rgs. 2 and 3 above. 
Those skilled In the art will appreciate that this is a com- 
puter-implemented process that is earned out by the 
computer In response to input from the user and instruc- 
tions provided by a program module. 
[0032] Referring to Fig. 4. the method 400 begins at 
start step 405 and proceeds to step 410 when a user 
opens an electronic document (e.g., the will template 
described in Rg. 3) in application program module 205. 
In one embodiment, the electronic document is a word 
processing document or a spreadsheet document 
However, the invention is not limited to either of these 
specific types of electronic documents. 
[0033] At step 415, the user hovers a cursor over a 
string or places the Insertion point within a string in a 
section of the document incorporating a semantic label 
causing a dropdown menu to be displayed to the user 
In step 420. The dropdown menu typically displays a list 
of actions associated with a semantic label. The drop- 
down menu typically appears above and to the left of 
the semantic label. For example. If the user types the 
string "Redmond, Washington" In the sectfon labeled 
"Piace of Residence" the dropdown menu might display 
an action allowing the user to review the law relating to 
wills in the state of Washington. It should be understood 
that the application program module 205 sends a re- 
quest to the action DLL 215 to determine which actions 
are shown with each semantic label. The method then 



proceeds to step 425. 

[0034] In one embodiment of the Invention, applica- 
tion program module 205 may include the option to dis- 
play an in-document user interface to Indicate the loca- 

5 tion of a semantic label. This in-document user interface 
may use a colored indication to Indicate the location of 
a semantic label such as braclcets or underlining. For 
example, If the user types the string "Redmond, Wash- 
ington" in the section of the document labeled as a se- 

10 mantic category v/rth type label "Place of Residence," 
the document may look like this with the braclcets indi- 
cating semantic labeling: 

[Redmond, Washington] 

15 

[0035] Of course, the In-document user Interface may 
be any sort of indication. 

[0036] At step 425, the user is ghren the option of se- 
lecting one of the actions from the dropdown menu dis^ 

^ played in step 415. If the user does not select an actioh. 
the dropdown menu remains displayed until the user po- 
sitions thecursor or insertion point to another section of 
the document If the user does select an action from the 
dropdown menu (i.e., by clk:ldng on a selection), the 

2$ method proceeds to step 430. 

[0037] At step 430 , after the user has selected an ac- 
tion, the action DLL retrieves the selected action from 
the appropriate action plugnn. The action plug-Ins pref- 
erably are COM objects that are executed via oommu- 

30 nicatlon between the application program module and 
the action DUL. Parameters necessary to execute the 
action (the XML markup of the string labeled as being 
of a particular type, the XML maricup of the content rep- 
resenting the cun'ent selection) will be passed from the 

35 application program nrK>dule to the action DLL and, in 
turn, passed to the action plug-in. After an actton has 
been executed, the method returns to step 410 In which 
th e user may reposition the cu rsor or hover over anothe r 
semantic label in the document The method 400 then 

40 ends at step 499. 

[0033] in another embodiment , actions may be asso- 
ciated with sections of existing documents. For exam- 
ple, a court might receive a legal document, such as a 
property deed, in electronic fonm. The property deed 
may already have a specific structure such as the loca- 
tion of the property, the amount paid, and a description 
of the property boundaries. A developer may annotate 
tiie staicture of the document with semantic labels in a 
particular schema (e.g., XML) and build actions to pro- 

50 vide functionality for particular elements of the schema 
that appear in the document Thus, an action associated 
with the location 8ectk)n of the deed may cause a map 
showing the property to be displayed. 
[0039] Although the illustrath^e embodiments of the 

55 present invention have been described as implemented 
in a word processing program module, it should be un- 
derstood that the present invention may be implement- 
ed in other program modules, Including, but not limited 
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to, XML authoring programs and progranns such as the 
"POWERPCMf^m® presentation graphics program, the 
"VISIO" diagram drawing program and applications In- 
cluded in the "OFFICE' program module, both marketed 
by Microsoft Corporation of Redmond, Washington. 5 
[0040] The architecture of embodiments of the 
present Invention is designed to allow developers to pro- 
vide actions for labeled etrings or other content such as 
graphical objects which may include, for example, im- 
ages, photographs, or drawings. The strings or other to 
content may be associated with actions without the need 
for recognizer DLLs or recognizer plug-ins which are 
limited because they ere string based and thus do not 
accurately recognize non-string content. The developer 
may annotate sectbns of the docuo^nt with semantic 
labels so that the actions will be available no matter what 
is inserted In the annotated section by the user. The ar- 
chitecture also allows developers to write less code to 
provide actions since no recognition Is required. 
[0041] It should be understood that 111 ustrative embed- ^ 
iments of the present Invention are designed to be able 
to function without any action plug-In DLLs. For exam- 
ple, If there are no action plug-in DLLs, then the user 
may be presented with a menu Item that allows the user 
to go to a download site to Install an action plug-In DLL. 
[Q042| Although the present invention has been de- 
scribed above as Implemented in illustrative embodi- 
ments, it will be understood that alternative embodi- 
ments will become apparent to those skilled in the art to 
which the present invention pertains without departing 
from its splrl and scope. Accordingly, the scope of the 
present invention is defined by the appended claims 
rather than tlie foregoing description. 



Clalnis 

1 . For an electronk; system for creating and editing an 
electronic document, a nrrethod for associating ac- 
tions with semantk; labels in the electronic docu- ^ 
ment created in en application program module, the 
method comprising the steps of: 



3. The method of claim 1 , further comprising display- 
ing the piuratlty of actions received from the action 
plug-ins. 

4. The nnethod of claim 1 , wherein the plurality of ac- 
tions are predetennlned for each of the plurality of 
labels. 

5. A method tor associating actions with content in an 
electron^ document as the electronic document Is 
created in an a application program module, the 
method comprising the steps of: 

as the content is entered into the electronic 
document, associating the content with a se- 
mantic label, wherein the electronic document 
is annotated with a plurality of semantic labels; 
and 

determining a plurality of the actions associat- 
ed with the label. 

6. Die method of claim 5, further comprising display- 
ing an Indication that the label has been found for 
the content . 

7. The method of claim 6, further comprising the steps 
of: 

determining that a user has selected the con- 
tent; and 

in response, displaying the plurality of acttons 
to the user. 

8. The method of claim 5, further oomprising the steps 
of: 

receiving an Indication that one of the plurality 
of actbns has been selected; and 
In response to receiving an indication that one 
of the plurality of actions has been selected, 
then causing the appllcatk>n program module 
to execute the selected action. 



annotating the electronic document with a plu- 
rality of th e semantic labels; ^ 
receiving the plurality of labels in an action dy- 
namic link library: 

transmitting the plurality of labels to a plurality 
of action plug-ins; and 

determining, in the action plug-ins, a plurality of so 
actions based on the labels. 



9* The method of daim 5, wherein the step of associ- 
ating the content with a semantb label comprises 
associating a string of text with tiie semantk: label. 

1 0. The method of daim 5. wherein the step of associ- 
ating the content with a semantic label comprises 
associating a graphtoai object with the semantic la- 
bel. 



2. The method of claim 1 , wherein the step of anno* 
fating the eiectronk: document with a plurality of se- 
mantk: labels comprises annotating the electronic 55 
document with a plurality of extensible Markup Lan- 
guage (XML) elements. 



1 1 . The method of claim 8, wherein ttie applksation pro- 
gram module executes the selected action by de- 
termining whether an action plug-in dynamic link li- 
brary assigned to the action is avaflable; and 

If so, then receiving Instructions from the ac- 
tion dynamic link library assigned to tiie selected ac- 
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tion. 

^2. The method of claim 11, further comprising the 
steps of: 

if an action plug*in dynamic link library is not 
available, then using a Uniform Resource Lo* 
cator assigned to the action to navigate to a 
Web site and download the action plug-in dy- 
namic ilnk ifcrary. 

13. A system for associating actions with semantic la- 
bels in an electronic document, the system compris- 
ing: 

an application program module for annotating 
the electronic document with a plurality of the 
semantic labels; 

an action dynamic llnl< library connected to the 
application program module receiving the plu- 
rality of labels; and 

a plurality of action plug-ins connected to the 
action dynamic link library for receiving the plu- 
rality of labels and detemriining a pluraGty of ac- 
tions based on the labels. 

14. The system of claim 1 1 , wherein the semantic labels 
are extensible Markup Language (XML) elements. 

15. Jhe system of claim 1 1 further comprising a display 
module for receiving and displaying the plurality of 
actk>ns received fmm the actton plug-ins. 

16. For an electronk: system for creating and editing an 
electronic docunnent. a computer-readable medium 
having computer-executable instructions for asso- 
ciating a plurality of actions with semantb labels In 
the electronic document created in an application 
program module, comprising: 

annotating the electronic document with a plu- 
rality of the semantic labels; 
receiving the plurality of labels in an action dy- 
namic link library; 

transmitting the plurality of labels to a plurality 
of action plug-Ins; and 

determining. In the action plug-ins, the plurality 
of actions based on the labels and displaying 
the plurality of actions received from the plural- 
ity of action plug-ins. 

17. The computer-readable medium of claim 12, where- 
in annotating the electronic document with a plural- 
ity of semantic labels comprises annotating the doc- 
ument with a plurality of extensible Markup Lan- 
guage (XML) elements. 

18. A computer-readable medium having computer-ex> 



ecutable instructions for associating actions with 
content in an electronic document as the electronic 
document Is created in an a applbatlon program 
module, comprising: 

5 

as the content is entered into the electronic 
document, associating the content with a se- 
mantb label, wherein the electronic document 
is annotated with a plurarrty of semantic labels; 
^0 and 

determining a plurality of the actfons assodat- 
ed with the label; 

receiving an indbation that one of the plurality 
of actions has been selected; and 
IS in response to receiving an indk:atlon that one 

of the plurality of actions has been selected, 
then causing the application progrEun module 
to execute the selected action. 

20 19. The computer-readable medium of da^ 1 8, where- 
in associating the text with a semantc label com- 
prises associating the text with an extensible 
Markup Language (XML) element 

25 20. Thecomputer-readablemecQumofdaJmlS.further 
comprising displaying an Incficatlon that the label 
has been found for the content. 

21 . The computer-readable medium of claim 16. where- 
to in the appllcatk>n program module executes the se- 
lected action by detemnlning whether an action 
plug-in dynamk: link library assigned to the actk>n 

is available; and 

if so. then receiving instructions from the ac- 
35 tiondynamk: link libraryasstgnedtothesetectedac- 
ton. 

22. The computer-readable medium otdaim 1 8, where- 
in associating the content with a semantto label 

40 comprises associating a string of text with the se- 
mantk; label. 

23. Thecomputer-readable medium of claim 18, where- 
in assodating the content with a semantic label 

45 conprises assodating a graphical object with the 

semantk: label. 

24. Thecomputer-readable medium of claim 20. further 
comprising the steps of: 

so 

if an action plug-in dynamk: link library is not 
available, then using a Uniform Resource Lo- 
cator assigned to the action to navigate to a 
Web site and download the action plug-in dy- 
55 namic link library. 

25. For an electronic system for creating and editing an 
electronic document, a method for associating ac- 
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tions with extensible Markup Language elements 
(XML) in the electronic document created in an ap- 
plication program module, the method comprising 
theatepsof: 

5 

annotating the electronic document with a plu- 
rality of the XML elements; 
receiving the plurality of XML elements in an 
action dynamic llnic library; 
transmitting the plurality of XML elements to a 10 
plurality of action plug-ins; and 
detemiining, In the action plug>ins. a plurality of 
actions based on the XML elements. 

26. The method of claim 25, further comprising display- ts 
Ing the plurality of actions received from the action 
plug-ins. 

27. The method of claim 26, wherein the plurality of ac- 
tions are predetemnined for each of the XML eie- ^ 
ments. 
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